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Making the Film 


How Stanley and Stella came together 


At the SIGGRAPH '86 film show, Russell Noftsker, Chairman of the Board for 
Symbolics, Inc., leaned over to Tom McMahon, director of R&D at Symbolics 
Graphics Division (SGD), and said "Maybe we should do a film." He was thinking, as 
were many others in management, that Symbolics needed a higher profile in the 
animation community. A film would be a good way to show that the Symbolics 
animation and paint system was capable of challenging and attractive animation. A 
successful film would be a valuable marketing tool. 


Tom McMahon, who would be the film's executive producer, agreed the film would 
be good for the company's image. He also knew that some of the software developers 
on his staff had been itching to do production work. Many had worked on feature 
films before coming to SGD, but production at SGD had been limited to occasional 
commercials, notably for HBO and Playboy Television. The film would also be 
beneficial since production work would give the developers more of a feel for their 
customers’ concerns and would undoubtedly suggest new features for the animation 
system. 


For the SGD developers, the film was an opportunity to try out some of the 
experimental programs and see how far the system could be pushed. The developers, 
who best knew the system, would have several months to find out what it could and 
could not do. 


With everybody agreed, an initial commitment was made to produce a 20-second spot 
that featured the boids behavioral animation software written by Craig Reynolds. It 
was Gary Demos's idea to feature the experimental flocking motions since the interest 
generated by the software would ensure the film's acceptance by the SIGGRAPH film 
jury. Demos was involved because Whitney/Demos Productions (WDP) would help 


produce the film. Working on a film with Symbolics would be a good way for WDP 
to learn as much as possible about the Symbolics system before taking in paying jobs. 


Getting off the ground 


The 20-second flocking motion spot envisioned in the beginning didn't stay simple for 
long. With WDP's Philippe Bergeron available, the film was expanded to include 
character animation. Along with characters comes a story so Robert Fusfield was 
asked to design a storyboard that combined character animation and flocking motion. 
His concept hinted at a love story between Stanley the bird and Stella the fish. The 
actual events of this love story evolved over time, but Fusfield's original concept of a 
globe and separate worlds stayed till the end. 


The schedule drawn up in January by producer Michael Wahrman called for rough 
animation and audio to be complete by the time of the jury version (the version sent to 
the SIGGRAPH jury for acceptance to the film show). The weeks immediately before 
the final deadline would be used for rendering, re-rendering, and fine-tuning. This 
schedule turned out to be optimistic. The animation was far from complete. Jim Ryan 
constructed the jury version from almost everything that had been done to illustrate 
the story -- black-and-white storyboard frames, color storyboard frames, black-and- 
white S-Dynamics motion tests, S-Geometry shaded scenes, rendered frames. But 
enough animation (30%) had been completed that everybody was confident the film 
could be finished on time. All would have been fine, except that nobody liked the jury 
version. 


The cartoonish jury version made it clear that the static storyboard did not translate 
well into animated motion. The storyboard was not well designed for the high number 
of scene-to-scene cuts it contained, making the story difficult to follow even for those 
who knew the story. Philippe Bergeron, who did the character animation for the film 
and was part of the film jury, found himself having to explain the film to his fellow 
jurors. A more serious problem was the strong reaction of SGD's Marketing 
department, who, among others, objected to the ambiguous tones the film had 
acquired. 


However, there was nothing wrong with the individual scenes. The quick scene-to- 
scene cuts were bad and the story problematic, but these were solvable problems. And 
the animators were starting to understand better what they wanted in a film. As it was, 
Tom McMahon and his staff wanted the film project to continue. 


About this time, Michael Wahrman asked Larry Malone to take a more active role in 
directing the film. Michael also got his brother Wayne, a professional film editor, to 
critically review the piece. Wayne's suggestions amounted to redoing the storyboard, 


and this Larry and Michael agreed to do. The number of cuts was reduced and 
replaced with sweeping camera moves that slowly revealed the scene and allowed the 
viewer more of a feeling of the globe and its separate worlds. The length of the film 
was doubled since part of the jury version's incomprehensibility was the high speed at 
which the action unraveled. Simplifying the story also placed emphasis back on the 
flocking motion. The ending of the film was still in the air. 


Redoing the storyboard meant throwing away all previously completed frames. 
Instead of a few short weeks to finish a 68-second film for which 30% of the 
animation was finished, the animators would have a few short weeks to finish a two- 
minute film for which only the models were complete. The demands of the longer 
animation allowed no time for fine-tuning or rendering scenes twice. 


But the new schedule did force the animators to get down to business. Larry Malone, 
who would be the first to work on the script, would animate the camera. Since Larry 
was also the developer of S-Geometry, he could best exploit the possibilities of 
animating the camera. The script would then pass to Philippe Bergeron, who would 
animate the characters before passing the script to Craig Reynolds, who would 
animate his flocks. Certain shots required an additional step of placing panels and 
cylinders in the scene. 


This handing off of the script from one animator to another was not always so clean. 
Very often, two or more would be working simultaneously on the same object. The 
design of the system made this easy but left open the possibility that two versions of 
the same object might be saved out, one version not having the changes made to the 
other. This danger of "version skew" made it important that the animators 
communicate and motivated Larry Malone to add a post-film safeguard to decrease 
the chances 


New music was produced by Richard "Doc" Bailey to accompany the film. Doc's 
music was a complete change from the jungleland sounds and honking that had 
accompanied the jury version. Doc's music was majestic and, when combined with 
Larry's camera motions, entirely changed the tone of the film and gave many of the 
animators a renewed sense of purpose. 


Modeling and creation of objects 


The models for Stanley and Stella were about the only things salvaged from the jury 
version. The models had been constructed by the versatile Doc Bailey, who had had 
no previous experience on the Symbolics system. He created most of the subobjects 
that make up Stanley and Stella with the spline surface feature of S-Geometry. The 
spline surface starts out as a mesh of wires with control points that are manipulated to 


create a shape. When the desired shape is achieved, a polygonal approximation of a 
spline based surface is then generated from the control points. 


The fishes and birds of the flock and school are actually low-resolution versions of 
Stanley and Stella (here resolution refers to the number of polygons). The low- 
resolution versions were created by passing the models of Stanley and Stella through 
the derezzer, a program written by Michael Wahrman that reduces detail by sorting 
and dissolving edges according to the hardness of the edge. (The hardness of edges is 
determined by the size of the angle of two faces, though edges between faces 
possessing different attributes are preserved.) Whereas the high-resolution Stanley is 
made up of approximately 11,000 polygons, low-resolution Stanleys contain about 
1,000. (The derezzer will available to customers as part of the 7.2 S- 

Geometry hacks.lisp file.) 


The ice barrier that divides the globe required special attention because it had to be 
solid, yet breakable; detailed for close-up shots, yet general enough for long-distance 
shots; static yet dynamic. These difficulties were solved by Kevin Hunter who added 
new mapping features to S-Render. Variable resolution bump maps were added so 
that the bump-opacity map for the barrier had a 256 x 256 version for distant shots 
and a 512 x 512 version for close ups. The continuous, sparkling effect as the barrier 
breaks was achieved with the use of dynamic bump maps. Kevin computed a 3D 
matrix of data consisting of fractal noise using a prototype of the array processor then 
under development at SGD. Successive planar "slices" of this cube of data were used 
as frame-by-frame bump and opacity maps for the ice blocks. Because each slice 
varies only slightly from the slices on either side of it, a shimmering effect is 
produced by the smoothly changing maps as they interact with the Phong highlights. 


Through most of the animation, the ice barrier that divides the fish and bird worlds is 
a single object. For the shot in which Stanley breaks through the barrier, a compound 
object of 33 subobjects was substituted for the single object barrier. The compound 
barrier was modeled by Andy Kopra to create a jagged hole in the center of the 
barrier, with "cracks" that define the ice blocks and radiate from the point at which 
Stanley first contacts the ice. The falling and rotating blocks were controlled by a 
standard S-Dynamics script that was generated by software written by Andy; the 
speed and direction of translation and rotation were procedurally determined based on 
a simple dynamic model of the effect of Stanley's impact. This script was then 
included by Philippe as a subsequence in the script for the entire shot. A frame action 
in a separate sequence controlled the animation of the bump and opacity mapping of 
the ice blocks as they fell. 


The background starfield was rendered separately from the foreground scenes because 
the sphere on which it was mapped was so large that it forced setting a very large yon 


distance, which coupled with the small hither distance required by the close-up shots. 
Such a loss of numerical precision would cause the starfield to jitter. (See the article 
on keying, page 1, for how the background starfield was composited with the 
foreground scene.) 


Character animation 


Character animation has unique requirements because of the type of fluid motion it 
involves. Translations and rotations, which are usually sufficient for rigid body 
transformations, are of limited value in character animation, which requires an object's 
vertices to move in relation to one another. 


Spheres of influence is an S-Geometry facility that was written specifically to make it 
easier to define non-rigid motions. In using this feature, a vertex is selected and a 
spherical volume around the vertex is defined. Manipulating the selected vertex 
influences the vertices within the defined area. For example, as the selected vertex is 
pulled, the vertices within the defined area are pulled along with the selected vertex as 
if influenced by it. The effect of the influence is greatest on the vertices closest to the 
selected vertex and falls off for the vertices toward the outer edge of the sphere. The 
rate of falloff can also be controlled, making spheres of influence extremely powerful 
not only for simulating facial expressions but in all situations where there is 
continuous, elastic movement. The gentle side-to-side motions of Stella's fins were 
also animated by using this technique. 


Spheres of influence were used to manipulate an object by displacing its vertices from 
an initial state. Another new S-Geometry feature allowed the naming and saving of 
these displacements so they could be retrieved and animated in S-Dynamics. 

(See Hints and Hacks for instructions on animating a displacement.) 


Philippe Bergeron combined spheres of influence and displacements to create almost 
all of the character animation. Philippe began with an object in a neutral state and then 
used spheres of influence to manipulate the object to simulate an emotion such as 
"happy" or "sad." He then saved this configuration as a displacement. None of the 
expressions created by displacements were fixed, however. Any intermediate state of 
the vertices could be used to create an expression. Nor was the control limited to 
positions between the original and displaced states of the object; positions on either 
side of the defining states could also be used. Since multiple displacements were 
created separately for each object, Philippe could also control the order in which these 
displacements were animated. In one expression, Stanley might raise his eyebrow 
before smiling, while in another, Stanley might smile first, raise his eyebrow, and then 
turn his head. 


For the eye movement, Philippe used a technique in which the eyes are focused on 
some point of interest in space. As the head moves, the eyes shift to remain focused 
on the point of interest; as the point of interest moves, so do the eyes. The point of 
interest in the film was a scaling center, which was animated in S-Dynamics. The 
eyeballs were procedurally rotated by a frame action that "examined" the position of 
the scaling center frame by frame. 


Behavioral animation 


The centerpiece of the film is Craig Reynolds's boids program. Boids (bird-oid) is an 
experimental program that simulates flocking motion. Craig's program differs from 
conventional animation in that the paths of the individual boids are not scripted but 
are determined by rules of behavior and a system of constraints. The animator gives a 
general direction, "Go here," but the actual path to "here" is determined by the boid, 
which must "act" within certain constraints written into the program. A boid, for 
example, must avoid obstacles in its path. Other constraints are proper behavior for 
participation in a flock -- avoid collisions with flockmates, maintain velocity with 
them, and stay close to them. All constraints are prioritized, the most important being 
the avoidance of obstacles, the other parameters having declining importance. For 
example, a boid would prefer to change velocity rather than crash into an obstacle. 


Craig's program frees the animator from tediously specifying movement for each 
object and makes it possible to animate a great many objects when the complexity of 
the script specification would otherwise be extremely difficult. (The film's wide shots 
of the whole world contain approximately 90 fish and 70 birds.) The boids program 
essentially automates the work of scripting the complex paths of many objects, thus 
making certain animation tasks more accessible to the user in the same way that 
programming in general is becoming easier as lower-level implementation details are 
covered by layers of abstraction that represent the programmer's actual intent. 


The boids themselves are simply S-Geometry objects that, like objects created through 
use of S-Geometry menus, have their own coordinate systems and acquire their 
geometric characteristics from the defined class (or flavor) of 3d:object. Boids can be 
manipulated and rendered just like any other geometric object. However, boids are not 
animated individually but as part of a flock. To invoke the flock simulations, Craig 
adds subsequences that animate the target points toward which the boids fly. 


Netrendering 


All during the animating process, shots were being rendered as they were finished, 
constituting 4200 frames. 


The problem here was machine time. Assuming an average time of two hours for each 
frame (two hours was a conservative estimate; many frames were rendered in about 
20 minutes), more machine time was required than could be found on the company's 
currently available machines. Employees at SGD and the Symbolics Cambridge 
Research Center (SCRC) donated machine time on weekends and evenings. On the 
most productive weekend, 65 machines at SGD and SCRC were churning out frames. 
This was still not enough machine time for a film whose most complex scenes 
contained approximately 225,000 polygons and between 100 and 200 moving objects. 
Other effects, such as numerous layers of transparency, also required intensive 
computation. 


Fortunately SGD was able to borrow 25 machines at the manufacturing plant in 
Chatsworth, CA, to be used full time for rendering. (These machines were dubbed the 
"fish farm.") The 25 machines were net worked together by the NetRender system, a 
program written by Joseph Goldstone to automate the process of rendering the frames 
of a script. A script was sent over the network to the "farm" and loaded on a central, 
controlling machine. (Models for each object were stored at all sites to eliminate 
transferring objects across the network for each rendering run.) The central machine 
directed the other machines, designated inkers, to load the script, load any referenced 
objects or maps, and then "ink" a frame of the script. 


The central machine monitored each inker and its frame, farming out frames to idle 
inkers. If an inker crashed while rendering a frame, the central machine reassigned 
that frame to the next free inker. Unlike a single-machine render run, a machine crash 
did not halt the animation. A crash of one machine simply slowed rendering by less 
than 5%. One morning, a partial power interruption in the San Fernando Valley power 
grid knocked out most inkers so the farm was running at 20%. but the central machine 
and a handful of the more determined inkers were unaffected and continued rendering. 


Postproduction 


Once the rendering was complete, image data was returned from Cambridge and 
Chatsworth to SGD over the network. Jim Ryan, the video consultant to SGD, loaded 
the images into a frame buffer connected to a 1" videotape recorder and dumped the 
frames to tape. In many cases a frame was recorded on tape within two hours of being 
rendered. 


Separate tapes for the foreground scene, starfield, and the mattes from the foreground 
images were made and then later composited. (See Jim's article on keying.) 


Audio 


The music was extremely important in setting the tone for the film. However, the 
music was of secondary importance to the animators who were concerned primarily 
with visual effects. Though the animators realized the importance of the background 
music -- Doc's music very effectively showed how music could convey and even 
change the mood of a film -- soundtrack concerns were not taken into consideration 
when the film was designed or animated. 


It wasn't until the beginning of July that Jill Frazer was asked to write the music. By 
that time the animation was complete and her job was to tailor the music to the film. 
To write the music, Jill listened to previous soundtracks to get an idea of what the 
animators wanted. She wrote the final music in less than a week. The music she 
produced not only conveyed the tone the animators were looking for but played a 
critical part in the overall success of the film. 


